Substitute Specification 
Clean Version 



1 



DESCRIPTION 

MEDIUM SIGNAL TRANSMISSION METHOD, RECEPTION 
METHOD, TRANSMISSION/RECEPTION METHOD, AND DEVICE 

5 

TECHNICAL FIELD 
[0001] 

The present invention relates to a medium signal transmission 
method, reception method, transmission/reception method, and 

10 device, and more particularly to a method, device, and program 
suitable for the bidirectional transmission and reception of medium 
signals (audio and image) over a wired transmission line or a 
wireless transmission path. 
BACKGROUND ART 

15 [0002] 

Recently, a method for transmitting highly compressed 
encoded data is used in many cases as a method for efficiently 
transmitting audio and video data. 
[0003] 

20 There are many methods for distributing audio/video 

compressed coded information to an IP (Internet Protocol) network 
utilizing packet-switching system. 
[0004] 

In case wherein such a transmission/reception of audio/video 
25 data is carried out over a wired IP network or an IP network that 
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includes wireless zones, if an IP network is congested or if a 
wireless error or loss is generated in a wireless zone, a request to 
retransmit the lost data is usually sent to request the transmission 
side to retransmit the corresponding packet. 
5 [0005] 

As a video conference terminal that improves the image 
quality by controlling the ratio of the audio bandwidth to the total 
communication bandwidth, a configuration is disclosed in which the 
encoding rate of an audio encoder is controlled based both on the 

10 image encoded data size, detected based on the usage capacity of the 
image encoding data buffer, and on the audio data encoding rate 
detected based on the usage capacity of the audio encoding data 
buffer (for example, see Patent Document 1 below). An AV 
transmission/reception system is also known that monitors the 

15 amount of data stored in the receive buffer and, based on the relation 
between the stored data amount and the threshold, varies the receive 
clock frequency (for example, see Patent Document 2). 
[0006] 

Patent Document 1: Japanese Patent Kokai Publication No. 
20 JP-P2001-333401A (page 4, FIG. 1) 

Patent Document 2: Japanese Patent Kokai Publication No. 
JP-P2002-165148 (pages 3-4, FIG. 4) 
DISCLOSURE OF THE INVENTION 
PROBLEMS TO BE SOLVED BY THE INVENTION 
25 [0007] 



However, during audio/image communication (for example, 
videophone), data cannot usually be retransmitted because the 
retransmission involves a time delay. This generates a problem that, 
when a packet is lost, the reception side suffers from quality 
degradation. 
[0008] 

In addition, when an image data reception device moves out of 
a wireless area (cell) and moves to an adjacent wireless area, a 
handover occurs. During this handover period, the data reception is 
stopped and a large amount of data is lost. This exhausts the output 
buffer of the reception device, causing the device to stop or freeze 
the video image screen and to interrupt or mute the audio. 
[0009] 

The problems similar to those described above also occur not 
only when a handover occurs between wireless zones but also when 
the bandwidth varies from time to time in a wired IP network. 
[0010] 

In view of the foregoing, it is an object of the present 
invention to provide a method, device, and computer program for 
minimizing the degradation of reception quality when the wait varies 
depending upon the time in an IP network, which includes a wired IP 
network and wireless zones, when medium signals such as videos or 
audios are distributed. 
[0011] 

It is another object of the present invention to provide a 



4 



method, device, and computer program for minimizing the 
degradation of reception quality even if a handover occurs in 
wireless zones. 
[0012] 

5 A transmission device according to one aspect of the present 

invention, which achieves the above objects, comprises an encoder 
unit that outputs a stream, obtained by receiving and encoding a 
medium signal, to a transmission line or wireless transmission path; 
and a control unit that controls the encoder unit to change a 
10 compression rate thereof and output the stream, when a 
predetermined control signal is received from the transmission line 
or path. 
[0013] 

A transmission device according to another aspect of the 
15 present invention comprises an encoder unit that outputs a stream 
obtained by receiving and encoding a medium signal; and an output 
control unit that receives the stream output from said encoder unit, 
and that performs control, when a predetermined control signal is 
received from said transmission line or path, to output the stream to 
20 the transmission line or path at a time interval different from a time 
interval at which the medium signal has been encoded by said 
encoder unit. 
[0014] 

A reception device according to one aspect of the present 
25 invention comprises a decoder unit that decodes a stream received 
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from a transmission line or wireless transmission path; a buffer unit 
that stores a medium signal decoded and produced by the decoder 
unit; and a control unit that monitors a storage amount of the buffer 
unit, and that outputs a control signal to the transmission line or 
5 path if the storage amount of the buffer unit exceeds or falls below a 
predetermined threshold. 
[0015] 

A reception device according to another aspect of the present 
invention comprises a decoder unit that decodes a stream received 

10 from a transmission line or wireless transmission path; a monitor 
unit that monitors a reception status of the transmission line or path; 
and a control unit that outputs a control signal to the transmission 
line or path based on a notification from the monitor unit if the 
reception status becomes a predetermined status. 

15 [0016] 

A transmission/reception device according to one aspect of the 
present invention comprises a decoder unit that receives and decodes 
a stream; a buffer unit that stores a decoded medium signal; a first 
control unit that monitors an buffer amount, and that outputs a 

20 control signal to a transmission line or wireless transmission path if 
the buffer amount exceeds or falls below a predetermined threshold; 
an encoder unit that encodes a medium signal and outputs a stream; 
and a second control unit that controls the encoder to change a rate 
and output the stream, when the control signal is received from the 

25 transmission line or path. 
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[0017] 

A transmission/reception device according to another aspect 
of the present invention comprises a buffer unit that receives and 
decodes a stream and stores a decoded medium signal; a first control 
5 unit that monitors a buffer amount and that outputs a control signal 
to a transmission line or wireless transmission path if the buffer 
amount exceeds or falls below a predetermined threshold; and a 
second control unit that encodes a medium signal and outputs a 
stream, and that, when the control signal is received, outputs the 
10 stream at a time interval different from a time interval at which the 
medium signal has been encoded by the encoder unit. 
[0018] 

A transmission/reception device according to another aspect 
of the present invention comprises a decoder unit that receives and 

15 decodes a stream; a monitor unit that monitors a reception status; a 
first control unit that that outputs a control signal to a transmission 
line or wireless transmission path if the reception status becomes a 
predetermined status; an encoder unit that encodes a medium signal 
and outputs a stream; and a second control unit that outputs a stream 

20 at a time interval different from a time interval at which the input 
signal is encoded when the control signal is received from the 
transmission line or path. 
[0019] 

A transmission method according to the present invention is a 
25 method for outputting a stream, obtained by receiving and encoding a 
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medium signal, to a transmission line or wireless transmission path, 
wherein the method may be controlled in such a way that the stream 
is output by changing a compression rate of the encoding processing 
when a predetermined control signal is received from the 
5 transmission line or path, or in such a way the stream is output to the 
transmission line or path at a time interval different from a time 
interval at which the medium signal has been encoded when the 
predetermined control signal is received from the transmission line 
or path. 
10 [0020] 

A reception method according to the present invention 
comprises the steps of receiving and decoding a stream; monitoring a 
storage amount of a buffer unit in which a medium signal obtained 
by the decoding is stored, and outputting a control signal to the 
15 transmission line or path if the storage amount of the buffer unit 
exceeds or falls below a predetermined threshold or based on a 
monitoring result of a reception status. 
MERITORIOUS EFFECT OF THE INVENTION 
[0021] 

20 The present invention minimizes a distortion in the image 

quality or sound quality in the bidirectional wireless communication 
of moving images even if a handover occurs in a wireless interval on 
an image reception device side or the reception status changes over 
time because of congestion or a packet loss in a wireless network or 

25 an IP network. 
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[0022] 

In addition, the present invention, which gives the effect 
described above, reduces the processing amount on both the 
transmission side and the reception side. 
5 BRIEF DESCRIPTION OF THE DRAWINGS 
[0023] 

FIG. 1 is a diagram showing the configuration of an image 
data distribution device (transmission device) in a first embodiment 
of the present invention. 
10 FIG. 2 is a diagram showing the configuration of an image 

data distribution device (transmission device) in a second 
embodiment of the present invention. 

FIG. 3 is a diagram showing the configuration of an image 
data distribution system in a third embodiment of the present 
15 invention. 

FIG. 4 is a diagram showing the configuration of an image 
data distribution system in a fourth embodiment of the present 
invention. 

FIG. 5 is a diagram showing the configuration of an image 
20 data distribution system in a fifth embodiment of the present 
invention. 

FIG. 6 is a diagram showing the configuration of an image 
data distribution system in a sixth embodiment of the present 
invention. 
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EXPLANATION OF NUMERALS 
[0024] 

101, 101A an image data distribution device 

102 control unit 

5 104 encoder 

106 transmission path 

107,107A image data reception device 

108 control unit 

109 image encoded data reception unit 
10 110 wireless status determination unit 

1 1 1 buffer unit 

112 decoder 

120 image signal 

121, 122, 123 control signal 

15 204 image stream output control unit 

BEST MODE FOR CARRYING OUT THE INVENTION 
[0025] 

Embodiments of the present invention will be described. The 
transmission side of a transmission/reception device in one 

20 embodiment of the present invention comprises an encoder (102) that 
receives and encodes a medium signal, including images and/or 
audios, as an input, and create distribution data to outputs the 
distribution data as a stream; and a control unit 102 that changes the 
compression rate of the encoder (102) when a control signal (121) is 

25 received from a transmission path (106). 
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[0026] 

In another embodiment of the present invention, the 
transmission side may be configured to have an output control unit 
(204) that controls to output the stream at a time interval different 
5 from a time interval at which the input (source) is encoded, when a 
control signal (121) is received from a transmission path (106). 
[0027] 

In one embodiment of the present invention, the reception side 
comprises a control unit (108) that monitors the storage amount of a 
10 buffer unit (111) that stores a medium signal obtained on decoding a 
stream by a decoder (112), and outputs a control signal (123) to a 
transmission line or path if the storage amount of the buffer unit 
exceeds or falls below a predetermined threshold. 
[0028] 

15 In another embodiment of the present invention, the reception 

side may monitor a reception status and, based on the monitor result, 
outputs a control signal (123) to a transmission line or path when a 
handover is detected based. 
[0029] 

20 The following describes a transmission method in one 

embodiment of the present invention. The transmission method in 
one embodiment of the present invention includes steps Al and A2 
described below. 
[0030] 

25 Step Al: A medium signal is received and encoded by. an 
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encoder to create distribution data and output a stream. 
[0031] 

Step A2: When a predetermined control signal is received 
from a transmission line or wireless transmission path, control is 
5 performed to change the compression rate of the encoder and output 
the stream. 
[0032] 

A transmission method in another embodiment of the present 
invention includes steps All and A12 described below. 
10 [0033] 

Step All: A medium signal is received and encoded by an 
encoder to create distribution data and output a stream. 
[0034] 

A12: In case of outputting the stream encoded by the encoder 
15 to a transmission line or wireless transmission path, when a 
predetermined control signal is received from the transmission line 
or path, output control of the stream is performed so that the stream 
is output at a time interval different from a time interval at which 
the received media signal has been encoded by the encoder. 
20 [0035] 

A reception method in one embodiment of the present 
invention includes steps Bl and B2 described below. 
[0036] 

Step Bl: A stream transmitted to a transmission line or 
25 wireless transmission path is received and the stream is decoded. 
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[0037] 

Step B2: The storage amount of a buffer that stores a medium 
signal, obtained by the decoding, is monitored and a control signal to 
the transmission line or path is output if the storage amount of the 
5 buffer exceeds or falls below a predetermined threshold. 
[0038] 

A reception method in another embodiment of the present 
invention includes steps Bll and B12 described below. 
[0039] 

10 Step Bll: A stream transmitted to a transmission line or 

wireless transmission path is received and the stream is decoded. 
[0040] 

Step B12: The reception status of the transmission line or path 
is monitored and, if the reception status becomes a predetermined 
15 status, a control signal is output to the transmission line or path 
based on a notification from the monitor unit. 
[0041] 

Another transmission/reception method according to the 
present invention is suitable for bidirectional medium 
20 transmission/reception, the transmission side includes steps Al and 
A2 or All and A12, described above, and the reception side includes 
steps Bl and B2 or steps Bll and B12. 
[0042] 

The processing/function of steps Al, A2, All, and A12 may be 
25 implemented by a program stored on a computer program storage 
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device, the program executed by the computer (or processor) on the 

transmission side. 

[0043] 

The processing/function of steps Bl, B2, Bll, and B12 may be 
5 implemented by a program stored on a computer program storage 
device, the program executed by the computer (or processor) on the 
transmission side. 
EMBODIMENTS 
[0044] 

10 The following describes the present invention with reference 

to the attached drawings to describe it more in detail. FIG. 1 is a 
diagram showing the configuration of a first embodiment of the 
present invention. It is assumed that image and/or audio data is 
transmitted by UDP/IP via a transmission path 106 on which IP 

15 (Internet Protocol) is being built on a wireless physical layer. An 
image data reception device not shown is, for example, a client 
terminal, connected to a wireless IP network, to receive image 
encoded data using UDP (User Datagram Protocol)/IP. 
[0045] 

20 Referring to FIG. 1, an image data distribution (transmission) 

device 101 comprises an encoder 104 for encoding a received image 
signal and a control unit 102. The encoder 104 (also called a 
"streaming encoder") encodes a received image signal 120 at a 
predetermined bit rate and outputs it to the transmission path 106 as 

25 a stream. The image signal or the like received may be a file or, in 
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case of live distribution, data from a camera or the like. 
[0046] 

When a control signal 121 is received from the transmission 
path 106, the control unit 102 outputs a control signal 122, which 
5 changes the bit rate of image data, to the encoder 104, and the 
encoder 104 changes the encoding bit rate (compression rate) of the 
image data (for example, changes the rate to a lower bit rate) 
according to the control signal 122 and then outputs the image data 
to the transmission path 106. In this embodiment, the image data 

10 reception device, not shown, transmits the control signal to the 
transmission path 106 when there is a possibility that the receive 
buffer of image encoded data is going to be exhausted. The 
transmission path 106, on which IP (Internet Protocol) is assumed to 
be built on the wireless physical layer, uses UDP/IP as the 

15 transmission protocol. As the control signal, RTCP (Real Time 
Transport Protocol) defined by IETF (Internet Engineering Task 
Force) as RFC, an extended version of RTCP being drafted by IETF, 
or RTSP (Real Time Streaming Protocol) defined by IETF as RFC 
(Request For Comments) may be used. This applies also to the 

20 embodiments given below. 
[0047] 

Although the transmission device (distribution device) and the 
reception device are described as separate devices in FIG. 1 to 
simplify the description, it is also possible that both the transmission 
25 function and the reception function are mounted in one device as a 
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transmission/reception device. In this case, both functions of the 
transmission device and the reception device described in this 
embodiment are implemented by one device. This applies also to 
the embodiments given below. 
5 [0048] 

FIG. 2 is a diagram showing the configuration of a second 
embodiment of the present invention. Referring to FIG. 2, an image 
data distribution device 101A in this embodiment has the 
configuration of the image data distribution device 101 in FIG. 1 to 

10 which an image stream output control unit 204 is added. An 
encoder 104 encodes a received image signal at a predetermined bit 
rate and outputs the image signal to a transmission path 106 as a 
stream. When a control signal 121 is received from the 
transmission path 106, the control unit 102 outputs a control signal 

15 122 to the image stream output control unit 204. 
[0049] 

When the control signal 122 is received from the control unit 
102, the image stream output control unit 204 reads the image 
encoded data at a time interval T at which the data is encoded by the 
20 encoder 104 or at a time interval T' different from the clock T, or 
with a different clock T', and outputs the data to the transmission 
path 106. 
[0050] 

FIG. 3 is a diagram showing the configuration of a third 
25 embodiment of the present invention. Referring to FIG. 3, an image 
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data distribution device 101 has a configuration similar to that of the 

image data distribution device 101 shown in FIG. 1. 

[0051] 

An image data reception device 107 receives image encoded 
5 data from a transmission path 106 via an image encoded data 
reception unit 109, temporarily stores the data in a buffer unit 
(storage device) 111 and, after absorbing packet fluctuation and 
delay in arrival of packet on the transmission path 106, outputs the 
data to a decoder 112. The buffer unit 111 has a buffer (storage 
10 unit) for storing the medium signal decoded by the decoder 112. 
[0052] 

Although the buffer unit 111, in which the received image 
encoded data is temporarily stored, is provided externally to the 
image encoded data reception unit 109 for the clarity of description, 

15 it is of course possible to configure a buffer, in which image encoded 
data is temporarily stored, in the image encoded data reception unit 
109. In this case, the image encoded data is supplied from the 
image encoded data reception unit 109 to the decoder 112, and the 
buffer unit 111 in FIG. 3 has a buffer only for storing the medium 

20 signal decoded by the decoder 112. The image signal decoded by 
the decoder 112 is displayed on a display device not shown. 
[0053] 

A control unit 108 measures the storage amount of a buffer, in 
which the decoded medium signal is stored, at a predetermined time 
25 interval and, when the storage amount of the buffer in which the 
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decoded medium signal is stored is going to be exhausted, transmits 
a control signal 123 to the transmission path 106. It is also 
possible for the control unit 108 to compare the storage amount of 
the buffer, in which the decoded medium signal is stored, with a 
5 predetermined upper or lower threshold to determine if the buffer is 
exhausted. As a modification of this embodiment, it is also 
possible that the control unit 108 controls the output of the control 
signal 123 based on the storage amount of the buffer in which the 
received image encoded data is temporarily stored. 
10 [0054] 

When a control signal 121 is received from the image data 
reception device 107 via the transmission path 106, a control unit 
102 of the image data distribution device 101 outputs a control 
signal 122 to an encoder 104, changes the bit rate (compression rate) 

15 of the encoder 104 (for example, to a lower bit rate), and outputs the 
data to the transmission path 106. Again, in this embodiment, the 
transmission path 106 on which IP (Internet Protocol) is assumed to 
be built on the wireless physical layer, uses UDP/IP as the 
transmission protocol. Note that the control signal 121 received by 

20 the image data distribution device 101 and the control signal 123 
transmitted from the image data reception device 107 are the same 
control signal. 
[0055] 

FIG. 4 is a diagram showing the configuration of a fourth 
25 embodiment of the present invention. Referring to FIG. 4, an image 
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data reception device 107 has a configuration similar to that of the 
image data reception device 107 shown in FIG. 3. An image data 
distribution device 101A shown in FIG. 4 has a configuration similar 
to that of the image data distribution device 101A shown in FIG. 2. 
5 [0056] 

A control unit 108 of the image data reception device 107 
measures the buffer amount of an encoded data buffer unit 111 at a 
predetermined time interval and, when the encoded data buffer unit 
111 is going to be exhausted, transmits a control signal 123 to a 
10 transmission path 106. 
[0057] 

When a control signal 121 is received from the image data 
reception device 107 via the transmission path 106, a control unit 
102 of the image data distribution device 101 outputs a control 

15 signal 122 to an image stream output control unit 204. The image 
stream output control unit 204 reads the image encoded data at a 
time interval T at which the data is encoded by an encoder 104, or at 
a time interval T' different from the clock T, or with a different 
clock T', and outputs the data to the transmission path 106. Note 

20 that, in FIG. 4, the control signal 121 received by the image data 
distribution device 101A and the control signal 123 transmitted from 
the image data reception device 107 are the same control signal. 
[0058] 

FIG. 5 is a diagram showing the configuration of a fifth 
25 embodiment of the present invention. Referring to FIG. 5, an image 
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data distribution device 101 has a configuration similar to that of the 
image data distribution device 101 in FIG. 1. The configuration of 
an image data reception device 107A is similar to that of the image 
data reception device 107 shown in FIG. 3 except that a wireless 
5 status determination unit 110 is added. 
[0059] 

The wireless status determination unit 110 of the image data 
reception device 107A monitors the wireless reception status of a 
transmission path 106 and, when the reception status becomes a 

10 predetermined status, notifies a control unit 108 about the status, and 
causes the control unit 108 to output a control signal 123 to the 
transmission path 106. When a control signal 121 (buffer 
exhaustion status) is received from the image data reception device 
107A via the transmission path 106, a control unit 102 of the image 

15 data distribution device 101 outputs a control signal 122 to an 
encoder 104, changes the encoding bit rate (compression rate) of the 
encoder 104, and outputs the data to the transmission path 106. In 
response to the control signal 122, the encoder 104 changes the bit 
rate, for example, to a lower bit rate. In FIG. 5, note that the 

20 control signal 121 received by the image data distribution device 101 
and the control signal 123 transmitted from the image data reception 
device 107A are the same control signal. 
[0060] 

FIG. 6 is a diagram showing the configuration of a sixth 
25 embodiment of the present invention. Referring to FIG. 6, an image 
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data distribution device 101A has a configuration similar to that of 
the image data distribution device 101A shown in FIG. 2. An image 
data reception device 107A is similar to the image data reception 
device 107A shown in FIG. 5. 
5 [0061] 

A wireless status determination unit 110 of the image data 
reception device 107A monitors the wireless reception status of a 
transmission path 106 and, when the reception status becomes a 
predetermined status, notifies a control unit 108 about the status, and 

10 causes the control unit 108 to output a control signal 123 to the 
transmission path 106. When a control signal 121 is received from 
the image data reception device 107A via the transmission path 106, 
a control unit 102 of the image data distribution device 101A outputs 
a control signal 122 to an image stream output control unit 204. 

15 The image stream output control unit 204 reads the image encoded 
data at a time interval T at which the data is encoded by the encoder 
104 or at a time interval T' different from the clock T, or with a 
different clock T', and outputs the data to the transmission path 106. 
In FIG. 6, note that the control signal 121 received by the image data 

20 distribution device 101A and the control signal 123 transmitted from 
the image data reception device 107A are the same control signal. 
[0062] 

The wireless status determination unit 110 may be composed 
by a handover determination unit that monitors the wireless 
25 reception status of the transmission path 106 and notifies the status 
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to the control unit 108, if the wireless status indicates that a 
handover that determines a handover from the current wireless area 
(cell) to an adjacent cell occurs. 
[0063] 

5 Although the present invention has been described with 

reference to the preferred embodiments given above, it is apparent 
that the present invention is not limited to the configuration of the 
above embodiments but that various modifications and changes in 
accordance with the principle of the present invention are included. 



